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Abstract 

Minimal 5*3 invariant Higgs potential with real soft ^3 breaking masses is investigated. It is 
required that without having a problem with triviality, all physical Higgs bosons, except one 
neutral one, become heavy ^ 10 TeV in order to sufficiently suppress flavor changing neutral 
currents. There exist three nonequivalent soft mass terms that can be characterized according 
to their discrete symmetries, and the one which breaks 5*3 completely. The 6*2 invariant vacuum 
expectation values (VEVs) of the Higgs fields are the most economic VEVs in the sense that the 
freedom of VEVs can be completely absorbed into the Yukawa couplings so that it is possible to 
derive, without referring to the details of the VEVs, the most general form for the fermion mass 
matrices in minimal S'3 extension of the standard model. We find that except for the completely 
broken case of the soft terms, the S2 invariant VEVs are unique VEVs that satisfy the requirement 
of heavy Higgs bosons. It is found that they also correspond to a local minimum in the completely 
broken case. 

PACS numbers: 11.30.Hv, 12.60.Fr,12.15.Ff 
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I. INTRODUCTION 



A nonabelian flavor symmetry is certainly a powerful tool to understand flavor physics. 
In the case of the standard model (SM), where only one Higgs SU{2)l doublet is present, 
any nonabelian flavor symmetry has to be explicitly broken to describe experimental data. 
However, if the Higgs sector is extended, and Higgs flelds belong to a nontrivial representa- 
tion of a flavor group , phenomenologically viable possibilities may arise. The smallest 
nonabehan discrete group is 5*3 ^. It is a permutation group of three objects, and offers a 
possible explanation why there are three generations of the quarks and leptons Q, 0]. An 
5*3 invariant Yukawa sector of the SM has exactly flve independent couplings 0, |J 

1 : LaRaHa + LhRfjHh + LcRcHc, 

2 : La{Rb + Rc)Ha + Lh{Ra + Rc)Hb + Lc{Ra + Rb)Hc, 

3 : {Lb + Lc)RaHa + {La + Lc)RbHb + {La + Lb)RcHc, (1) 

4 : {LbRb + LcRc)Ha + {LaRa + LcRc)Hb + {LaRa + LbRb)Hc, 

5 : {LbRc + LcRb)Ha + {LaRc + LcRa)Hb + {LaRb + LbRa)Hc, 

where La, Ra and Ha correspond to three left-handed leptons, right-handed leptons and 
Higgs bosons, which are subject to permutations. The three dimensional representation 3 
of S3 is not an irreducible representation; 3 can be decomposed into 1 and 2 as 

1 : Hs = ^{Ha + Hb + H,), (2) 

2 : {H,,H2) = {^{Ha-Hb),^{Ha + Hb-2H,)), (3) 



and similarly for L's and -R's. 
pendent Yukawa couplings are 



n terms of the flelds in the irreducible basis, the flve inde- 



LiRiHs, fijkLiRjHk, LsRsHsi LsRiHi, LiRsHi, (4) 



^ Flavor symmetries based on a permutation symmetry have been considered by many authors in the past. 
One of the first papers on permutation symmetries are See for a review. Phenomenolog- 

ically viable models based on nonabelian discrete flavor symmetries D4 and and also on a product 
of abehan discrete symmetries have been recently constructed in [3, 0, 0, Q|, Q, 0, 0, 0, 0| 
and 001, respectively. (See also 000 00|. ) Howeverj_it is difficult to understand bi-large 



mixing of neutrinos in terms of abelian discrete symmetries alone 
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where i,j,k run from 1 to 2, and 



/ll2 — /l21 — /2II — — /222 — 1- (5) 

It has been found in j^, 1^ that these Yukawa couphngs are sufficient to reproduce the 
masses of the quarks and their mixing, and that they are not only consistent with the 
known observations in the leptonic sector, but also can make testable predictions in the 
neutrino sector if one assumes an additional discrete symmetry in this sector. In deriving 
the fermion mass matrices, it has been assumed in 1^ that the vacuum expectation values 
(VEVs) of the Higgs fields are 5*2 invariant, i.e. 

<Hs> 0, < i/i >=< H2 >^ 0. (6) 

By the 5*2 invariance we mean an invariance under the interchange of Hi and H2, i.e. 

Hi ^ H2. (7) 

Note that this permutation symmetry is not a subgroup of the original 6*3. Although the 
Yukawa couplings (0} do not respect this symmetry, each term in the 5*3 invariant Higgs 
potential (given in Q) except for one term respects this discrete symmetry. Moreover, as 
we can see from (^, the S'2 invariant VEVs (jH)) are the most economic VEVs in the sense 
that the freedom of VEVs can be completely absorbed into the Yukawa couplings so that 
we can derive the most general form for the fermion mass matrices 



^ mi + 1712 ^2 ^5 ^ 



M 



(8) 



1712 m-i — 1172 TTlr, 

y 7714 rrii j 

without referring to the details of VEVs. In other words, if < Hi >^< H2 >, the mass 
matrices would have one more independent parameter which should be determined in the 
Higgs sector. 

In the present paper we would like to investigate how unique the S'2 invariant vacuum is 
under the requirement that except one neutral physical Higgs boson all the physical Higgs 
bosons can become heavy ^ 10 TeV without having a problem with triviality [2^. This 
bound results in order to suppress three-level flavor changing neutral currents (FCNCs) 
that contribute, for instance, to the mass difference ^iuk of and in 6*3 invariant 



extension of the SM 
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28|. [See also Ref. esented in 

Sect. 3 and 4, and the conclusions are summarized in the last section. In Sect. V we discuss 
the Pakvasa-Sugawara vacuum Q], and a supersymmetric case is treated in Sect. 6. 



II. ^3 INVARIANT HIGGS POTENTIAL AND SOFT S3 BREAKING 

A. Ss invariant Higgs potential and its problem 

The most general, S3 invariant, renormalizable potential is given by Q 

Vh = V2H + V^H, (9) 



V2H = -f^liHlH, + HIH2) - filHlH. 



s, 



V^H = +XiiHlH, + HlH2f + X2iHlH2-HlH,)^ 
+\3{{H\H2 + HlH^f + {hIh^ - HlH2f) 
+{>^ih,k{HlHi){H]Hk) + h.c] + X,{hIHs){hIHi + HIH2) 
+\,{{HlH,){HlHs) + {hIH2){hIHs)} 

+{H{hIh,){hIh,) + {hIh2){hIh2)] + h.c.} 

+\s{hIHs)\ (10) 
where A4 and A7 can be complex ^. We first redefine as 

H^ = ^{H,±H2), (11) 
and write the SU(2)l Higgs doublets in components: 

The down components of the Higgs doublets have zero electric charge, and therefore, we 
assume that only the down components can acquire a VEV. Further, because of U{1)y 
gauge invariance, it is always possible to make a phase rotation for Hs so that only the real 
part h^g can get VEV. We denote the VEVs as follows: 

<hl> = v±, < h^s >=vs ,< X± >= c± , (13) 
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The S3 invariant potential has been studied in 111 l2ll . for instance. Similar potentials with nonabelian 
discrete symmetries have been also studied in 



31il3Ei 



which should satisfy the constraint 

{vl + vl+vl + cl + c^)^/2 = ~ 246 GeV. (14) 
In order to reproduce reahstic fermion masses and their mixings |8|], we also require that 

vs 7^ 0, and at least one of v± and c± ^ (15) 

is satisfied, and do not allow a large hierarchy among the nonvanishing VEVs, unless it is 
noticed. [In sections II and III, we however allow such hierarchy.] 
There are five minimization conditions: 

= -vsfil + dV,H/dh% (16) 

= -v+ixl + dV^H/dhl, (17) 

= -v.^il + dVAH/dh^_, (18) 

= ^ dv^u/dxl, (19) 

= -c_^l + dVmldx^_, (20) 

We regard VEVs as independent parameters, and express the parameters of the potential ©, 
especially the mass parameters ^\ and /ig, in terms of the VEVs. To make all the physical 
Higgs bosons except one neutral Higgs boson without having large values of the Higgs quartic 
couplings A's, we have to have either — — /ii » v"^ oi » v"^, where v is defined in 
(jl4|) . For the first case, none of the VEVs can be 0(f), because the derivative terms, i.e. 
(9V4///(9/i° etc, are of O(VEV^). Therefore, this case can not satisfy the constraint (fT^. For 
the second case, /is and vs can be 0(f), but none of f+,f_,c+,c_ can be 0{y). That is, 
the hierarchy \vj^/vs\,\v-/vs\,\c+/vs\,\c-/vs\ « 1 has to be satisfied. This hierarchy is 
consistent with the minimization conditions ()17|) - (j^m) . only if at least one of the derivative 
terms, i.e. dV^n/dh^ etc, contains at least a term proportional to f|. However, this is 
not the case, as we can see from the potential V^h (|IDI)- Moreover, (fT^ does not allow 
f + = i;„ = c+ = c_ = 0. 

It is thus clear, if the two conditions (fT^ and (fT3j) are satisfied, that fJ^l, fJ^l ~ O(VEV^), 
which means that all the masses of the physical Higgs bosons are of O(VEV). That is, to 
have a large Higgs mass, the value of certain Higgs couplings A's have to be large. Then 
we are running into the problem with triviality; the Higgs mass can not be larger than 
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the cutoff. As we see from (j^I), the model has many Higgs couphngs, so that the known 
triviahty bound on the Higgs mass, ~ 700 GeV [2^, can not be directly applied . But we 
may assume that the bound for the present case does not differ very much from that of the 
SM. However, this upper bound is too law to suppress three-level flavor changing neutral 
currents (FCNCs) that contribute, for instance, to the mass difference Am^^ of and K^] 
certain Higgs masses in 5*3 invariant extension of the SM have to be larger than ~ 0(10) TeV 
. Therefore, in a phenomenologically viable 5*3 extension of the SM, 6*3 symmetry 



271, 



should be broken, unless there is some cancellation mechanism of FCNCs. 



B. Soft §3 breaking terms and their characterization 

As we have seen above, we have to modify the Higgs potential to make it possible 
that the Higgs masses can become lager than 10 TeV. How should we break 5*3? We would 
like to maintain the consistency and predictions of 5*3 in the Yukawa sector, while satisfying 
simultaneously the experimental constraints from FCNC phenomena. Therefore, we break 
5*3 as soft as possible. The softest operators in the case at hand are those of dimension two; 
that is, mass terms. There are four soft breaking mass terms 

VsB = -fil{HiH^-HlH^)-V2{filHlH+ + h.c.) 

-{ij,IhIh_ + h.c.) - V2{ij.IhIh_ + h.c). (21) 

/i| and /ig can be complex parameters ^. However, we assume that they are real param- 
eters in following discussions except in Sect. 5. We would like to characterize these four 
mass terms according to discrete symmetries: 

R 

Qll 
'-'2 

R X S'i 

^ The soft mass terni s_l|21|) may be generated from a S'3 invariant Higgs potential by introducing certain 6*3 
singlet Higgs fields ^ . 



: Hs ^ -Hs, (22) 

: H -H^, (23) 

: ^ -H+, (24) 

: Hs -Hs and H -H^, (25) 

: Hs -Hs and H+ -H+ (26) 

: H -H and H+ -H+, (27) 
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where 5*2 and 5*2 are not a subgroup of the original 5*3 . Accordingly, we characterize the soft 
mass terms ()21|) as 



^2 : /is — /^e — 0, 

5*2 : /i4 = /is = 0, 

Rx S2 : /i4 = /is = /i6 = 0, 

Rx S2 : /i4 = /is = /i6 = 0, 

^2 X 5*2 : /i4 = /is = /i6 = 0. 



R '■ iJ^4 — /ig — 0, 



(28) 
(29) 
(30) 
(31) 



(32) 
(33) 



Actually, there are only four nonequivalent soft breaking mass terms, including one without 
no discrete symmetry. This is because 5*2 and S2 are not independent: The Higgs potential 
© and the soft terms (j2ip are invariant under the interchange of and H_ if one ap- 
propriately redefines the coupling constants and mass parameters. In the next section we 
will discuss the three cases, i.e. R, S2 and R x S2 invariant cases, and in Sect. 4 we will 
treat the completely broken case, in which all the soft mass terms ()21|) are present. Each 
possibility is renormalizable, because all the other interactions are 5*3 invariant and can not 
induce infinite 6*3 violating breaking terms (j2ip . In principle, and /^e can be complex. 

As announced, however, we assume that they are real, except for Sect. 5. This is consistent 
with renormalizability from the same reason above. 

Before we go to the next sections, it may be worthwhile to write down explicitly the A4 
and A7 terms of the potential V^^h (HDI): 



+xlKf + x'-Kf + 2xlh%h'. - 2x° </i° - xl{h'-f - x'-{h'_f] 
+ (Re(A4)/i^ + Im(A4)x°5) [ixlfhl - {x'^fhl + 2xlx'-hl - 2xlx'-h'^ 
Hhl? - {h'y + ixlfh'- - {x'-fh'- + Khlfh'. - 3/i° (/i° , (34) 

= ^ [{{xir + ix'-f - {hir - {h^mix'sf - ih^n 

+Hxlhl + x'-h^}x'sh's] + Im(A.) [(x° /i° + x'-h^nix'sf - (h'sf} 

-{ixir + ix'-r - (hir - ih^nx'sh's] , (35) 



where only those terms containing the neutral components are written above. The rest of 
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the terms in V4H has the form 

6 

with ^^ni = 2 and nj = 0,1,2. 

1=1 

III. MINIMIZATION CONDITIONS AND HIGGS MASSES 

Below we will analyze the total potential Vr = Vh + Vsb for the three nonequivalent cases 
fOHj) , (Unj and (jSH) • We consider only phenomenologically viable cases (fT3j) . But we do allow 
if necessary a large hierarchy among the nonvanishing VEVs. In all the cases, A4 = follows 
from the discrete symmetry in question. 

R X S2 ( /i4 = /i5 = /i6 = 0; A4 = 0): 

The five minimization conditions in this case are given by 

= -vsfil + dV^H/dh'^s, (37) 

= -v+{fil + fil) + dV^n/dhl, (38) 

= -v^ifil - fil) + dV^u/dh'L, (39) 

= -c+{ii\ + + dV,Hldxl, (40) 

= -c_(^? - 111) + 9V4///9x° , (41) 

where the second derivative terms, i.e., dV^n/dh'^ and c^I^h/Sx", are ~ (9(VEV^). We first 
observe that because of the absence of A4 the condition ()37|1 requires /is ~ O(VEV). If 
I/if ± fill >> "^^ should be satisfied, then none of f+, f_, c+, c_ can be 0(f). But this is not 
consistent with ()38|l - (pT|l because of the absence of f | terms in the derivative terms of ()38|1 - 
(jH}. Therefore, taking into account the condition (fT3j). at least one of f+,f_,c+,c_ has to 
be 0(f). Assume that ~ 0(f), which means that fif = — /i^ + O(VEV^). Consequently, 
the total Higgs potential in this case can be written as 

Vt = -2filHlH_ + ..., (42) 

where the terms indicated by . . . are those which are proportional to VEV"" (n = 1, . . . , 4). 
Therefore, only if_ can obtain a large mass, if — 2/if is positive and large. So, this case does 
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not satisfy the phenomenological requirement that all the physical Higgs bosons except one 
can be made heavy without running into the problem with triviality. 

One can perform similar analyses for other cases such as c_ ~ 0(f). [f 5 7^ is always 
assumed.] As before, one finds that only one SU{2)l doublet can become heavy. So, the 
soft masses with the discrete symmetry R x S2 can not be used for a phenomenologically 
viable model. 

R (/i4 = /ig = 0; A4 = 0): 

The five minimization conditions in this case are given by 

= -vsfil + dV,H/dh^s (43) 

= -v+{fil + fil) - v.fil + dV,H/dhl, (44) 

= -v+fil-v^inl- fij) +dV4H/dh°_, (45) 

= -c+(/i? + fil) - c.fil + dV,H/dxl, (46) 

= -c+fil - c_ ifil dV,H/dx'. . (47) 

Again, because of (pSj). /is ~ O(VEV). l/isi has to be large, otherwise the situation is the 
same as in the previous case. Eqs. ()44|) and ()45p have a nontrivial solution 

' ' ^^^^ 

if f+ 7^ 0, f_ 7^ 0. Then the total potential becomes 

Vt = m^Hl^HH + ..., (49) 

where, as before, the terms indicated by . . . are those which are proportional to VEV"" {n = 
1, . . . , 4), and 

[vj^ + v_)^''^ V+V- 
Therefore, only Hh can become heavy. 

If f_ = 0, Eq. (ji^ requires | << 1 because l/isi >> v has to be satisfied. To satisfy 
Eq. (|45|) ■ on one hand, at least one of c+, and c_ has to be 0{v) because of the absence 
of f| terms in the derivative term. On the other hand, we obtain the equation ()48|) with 
v± c±. [c+ ~ O(VEV), c_ = and c+ = 0, c_ = O(VEV) can not satisfy ^ and 



The case f + = is equivalent to the case V- = 0. If f + = t;- = 0, the situation does not 
change. From these considerations, we conclude that the case at hand does not satisfy the 
phenomenological requirement. 



S'^: (/is = /i6 = 0; A4 = 0): 

The five minimization conditions in this case are given by 

= -vsfil - V2v+fil + dV4H/dh% (51) 

= -v+ifil + fil) - V2vsfil + dV,H/dhl, (52) 

= -v^ifil - + dV^H/dh^_, (53) 

= -c+if^l + fil) + dV,H/dxl, (54) 

= -c^ifil - fil) + dV.H/dx'- (55) 

Note that the derivative terms in ()53|) - (j33j) contain at least of one of f _ , c+ and c_ . Therefore, 
large values for /ii and fi2 can be consistent with only if (i) t>_ = c+ = c_ = 

and (ii) fij = fi^ + O(VEV^) or (iii) fif = —fi^ + O(VEV^). Keeping this in mind, we next 
solve (j3T|) and to obtain 

2 _ <(/x^ + /xi) + 0(VEV^) , _ v^{f,l + f,l) + 0{VEV') 



V 



V2vs 



Inserting into the total Higgs potential Vr, we obtain 

2 2 

Vt = -(/i? - fil)HlH. - UvsHl - v+Hl)ivsH+ - v+Hs) + h.c] +... (57) 

We see from (jHTjl that the case (ii) can be ruled out, because in this case can not obtain 
a large mass. We can also see from (j37j) that the case (iii) allows large values of the Higgs 
masses if \v+/vs\ ^ 40. However, (j^Hj) and (jSH) require that \v^/v\, \c^/v\ « 1. Note 
that the derivative terms of ()53|) and contain at least one of f_, c_, which implies that 
= c_ = to satisfy (|53p and (j55p . c+ is nonvanishing in the case (iii). For the case (i) we 
obtain the same form of the leading potential Vr, but no restriction on the ratio v^/vs- In 
terms of VEVs, we have f _ = c+ = c_ = for the case (i), and f _ = c_ = for (iii). These 
two types of VEVs are 5*2 invariant VEVs ^ . Both types of VEVs give rise to the general 
form of the ferminon mass matrix dHI) . 
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Below we would like to consider only the case (i) (f_ = c+ = c_ = 0), and give the mass 
matrix of the neutral scalar Higgs bosons 



, h^j;^ = sin 7 h'^ + cos 7 /i^, /i^ = cos 7 — sin 7 h 





5' 



(58) 



and the mass matrix the neutral pseudo scalar Higgs bosons 



X- , Xl = sin7 X+ + C0S7 Xs^Xh = C0S7 x+ - sin7 Xs 



,,0 



(59) 



are, respectively, given by 



/ 2 



m 
m 



h22 "^h23 



/i23 "^/i33 / 



/m^o \ 





m^o 

Xh 



(60) 



where 



"^L3 



2/i2 



72 cot 



7/^4 - 



[ 2(Ai + A3) sin^ 7 + 2 (^5 + As + 2A7) sin^ 27 + 2A8 cos^ 7 

,2 



(61) 
(62) 



y sin27[ (Ai + A3)(l - cos 27) + (A5 + Ae + 2A7) cos 27 - 2A8COS27 ], (63) 



m 



fe33 



2y2/i^/sin27 + y(Ai + A3 



A5 - Ae - 2A7 + As) sin" 27, 
2/i^ V2 + ii\ cot 7 - 2(A2 + \i)v\ - 2\-jvl, 



2V2 fill is,in2-i - 2A7t;^ 



and we have introduced (f = {v"]^ + t'l)^''^) 

tan 7 



(64) 
(65) 
(66) 



(67) 



In (jUT|) - (jU3jl . we have taken into account the higher order terms of (j37j) with A4 = Im(A7) = 0. 
[A4 = follows from the S2 symmetry.] If A4 and Im(A7) do not vanish, there is no local 
minimum for (i). As we can see from the mass matrices (jUOj) with the pseudo scalar 

boson (jnni), X-L; is the would-be Goldstone boson, and that except for all the physical Higgs 
bosons can become heavy without large Higgs couplings A's. We also find from and (jUTf) 
that only h\ acquires VEV. Since only h\ acquires VEV, its coupling to the fermions is flavor 
diagonal, while the other physical neutral Higgs bosons have FCNC couplings. However, 
still mixes with h^^ because of the nonvanishing entry m^23- Therefore, we have to so 
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fine tune that ^«^23 vanishes. (Of course, the mixing is suppressed by j /i| ~ 6 x 10~^ for 
/i4 ~ 10 TeV.) In this limit, m/tss and rxihri are the masses of /i^^- and the hghtest Higgs , 
respectively. 

IV. SOFT BREAKING WITHOUT SYMMETRY 

Here we would like to investigate the full potential Vt = Vh + Vsb without any assumption 
on abelian discrete symmetries. The reason is that 5*2 is not a symmetry of the theory; it 
can be a symmetry only in the Higgs potential. So, radiative corrections can induce finite 
non-5'2-invariant terms in the Higgs potential, for instance. Here we assume that all the soft 
masses (12 ip are present and that they are still real. We, however, do not allow an unnatural 
large hierarchy of the VEVs, in contrast to the previous sections. There are exactly nine 



nonequivalent possibilities that satisfy the phenomenological requirement 

Ai : = c+ = = 0; A2 : v+ = = = 0; (68) 

El : c+ = c_ = 0; ^2 : = c_ = 0; B3 : v_ = c+ = 0; : v+ = v_ = 0; (69) 

Ci : c_ = 0; C2:v. = 0; (70) 

D : none of them = 0. (71) 



It will turn out that among these nine possibilities only two cases Ai and Bi satisfy the 
phenomenological constraint that all the Higgs bosons except one can be made heavy without 
running into the problem with triviality. Note that Ai and also B2 exhibit the 5*2 invariant 

VEVs (ED. 

Ai {v_ = c+ = c_ = 0): 

We start with the case Ai. The first case Ai corresponds to the S2 invariant VEVs The 



nontrivial minimization conditions at f _ = c_|_ = c_ = are given by 

= -vs^ll - V2v+i4 + dVm/dh%, (72) 

= -t;+(^? ^ _ ^^^^2 ^ dV^Hldh% (73) 

= -^vs^ll - v+fil + dVAu/dh'l (74) 

= dV^u/dxl = v+vs{v+lui{X^)/2V2 + vslui{\j)), (75) 

= dV^H/dx''_ = -vlvs\m{K)/2V2. (76) 
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ml ~ 



+ 0(VEV') ~ (78) 



(f7^ requires = Im(A7) + {v+/2^/2vs)l^xl{X4,) , and ^7^i requires Im(A4) = 0. So, we assume 
that A7 and A4 are real. (In the case of the 6*2 invariant soft term (P^ . A4 has to vanish 
for the S'2 VEVs (0) to correspond to a local minimum.) We then use (f7^ -(jZH) to express 
/i^, /ig and /ig in terms of VEVs: 

fil = -y2/i^cot7 + 0(VEV2), (77) 

where 7 is defined in fj67j) . Inserting /x's of (ffTjl into the total potential, we can compute the 
mass matrices and find 

^ 2^1 + V2^lcoi-i 72/1^/ sin 7 ^ 



y V2/ig/sin7 2^2/2^/ sin 27 y 

for the basis ()58|) and (jSHI)- Comparing these results with (jUUj) . we find that apart from the 
0(VEV2) terms, the masses (j78|) reduce to those of the S'2 invariant case (|60|) as /ig (and 
hence ^\ because of (I77|) ) goes to zero. Therefore, the 5*2 invariant local minimum exists in 
the full Higgs potential, if all the mass parameters are real. 

M {v+ = v_ = 0): 

The five minimization conditions at = t)_ = c_ = (which is of the S'2 invariant type 
dni)) are given by 

= -vsfil + dV^H/dh% (79) 

= -V2vsiil + dViH/dhl, (80) 

= -^vsiil + dViu/dh'l. (81) 

= -c+(^? + ^il) + dV,Hldxl. (82) 

= -c+iil + dV^u/dx''-. (83) 

(f7^ - (jSni) imply ^ that /if, (/i? + ^2)^ ^l^ fA ~ O(VEV^). Inserting /I's above into the 
total potential, we find 

Vt = 2ij,lHiH_ +0{YEY*). (84) 



^ As announced, we do not allow an unnatural large hierarchy among the VEVs. If, for instance, Ivs/i"! << 
1, then can be large thanks to the nonvanishing A4. In this case, Hs can become heavy. 
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So, only if_ can become heavy. 



0): 



The five minimization conditions at c+ = c_ = are given by 

= -vsiil - V2v+iil - V2v^fil + dViH/dh% 

= -v+{iil + 111) - V2vsfil - v.fil + dV^H/dh^_^ 

= -v+iil - V2vsfil - v^ifil - fil) + dV^H/dh'L, 

= -{vl + 2v+v_ -v^^)vslm{X^)/2V2-v+vllm{Xr), 

= -{vl-2v+v^ -v^_)vslm{X4)/2V2-v^vllm{X7). 



(85) 
(86) 
(87) 
(88) 
(89) 

and (jHn|) require Im(A7) = Im(A4) = 0. Solving (jHSI), and (jHTjl to express fif, fil 
and /ig in terms of f5,f+ and f_, and inserting them into the total potential, we obtain: 



Vt 



+ [2iil{vslv+)+iil{v_/v+)\ hIh+ 



HlHs 



+ 
+ 



2/i2 + ^l{v^/v+) + V2^l{vs/v+) 



V2fil{v^/v+) - 2fil{v_/vs) + yt^^((^^+M) - {vl/v^vs))] {HlH_ + /i.c) 
IiI{hIh^ + /i.c) - V2i4{hIh+ + /i.e.) + O(VEV^). (90) 



One can show that except for = {vsh^s + ^+^+ + V-h'^)/ (f^ + + v'^Y^'^ all the physical 
Higgs bosons can become heavy. So, this case satisfies the phenomenological requirements. 

-82,3,4, Ci,2, D: 

We have performed similar analyses for the rest of the cases, and found that none of -82,3,4, 
Ci^2 and D cases satisfy our requirement (if we do not allow a large hierarchy among the 
VEVs). 



V. THE PAKVASA-SUGAWARA VACUUM 

The PaUvasa-Sugawara (PS) VEVs llUre giveu by 

f _ = c+ = 0, 
14 



(91) 



which is nothing but the case given in ()69|). As we mentioned, the 5*3 invariant potential 
does meet the requirement that except for one neutral physical Higgs boson, all the 
physical bosons can become heavy. On the other hand, the PS VEVs (19 1|) are the most 
economic VEVs in the case of a spontaneous CP violation; only one phase which should be 
determined in the Higgs sector enters into the Yukawa sector. Here we would like to analyze 
the most general case with complex soft masses in contrast to the previous sections. The 



minimization conditions are: 

= -vsl4 - V2v+Re{^il) + V2c_Im(/i2) + dV^H/dh^, (92) 

= -v+{^i\ + ^il) - V2vsRe{^il) + c_Im(/i2) + dViuldhl, (93) 

= -V2vsRe{i4) - v+Re{iil) + dVm/dh^_, (94) 

= ^/2vslHA) - C-Re(/i^) + dV^n/dxl. (95) 

= V2vslul{^il) + v^lui{i4) - c4fii - fil) + dV^n/dx-. (96) 



We solve to express /x^, /Xg, Im(/i4), Re/ig and Im(/ig) in terms of VEVs. We find 

that in the leading order, they are given by 

fij = (yU2^+ + V2Re{iJ,l)v+vs + V2lm{i4)vsc^ + fijc-^ /(cl - f+) 
+0(VEV2), 

fil = V2{-Re{fil){v+/vs) + lm{fil){c./vs)) + OiVEV'), 
Imifil) =- Re(/i^)(c_/t;+) + 0(VEV'), Re{fil) = -V2Re{iil){vs/v+) + 0{VEV^){97) 
lra{i4) = (y2Re{fxl)vsC_ + V2lm{iJ.l)v+Vs + 2i4v+c_^ /(c^ - f^) 
+0(VEV2). 

Inserting these mass parameters into the full potential, we have verified numerically that 
except for one neutral physical Higgs boson, all the physical bosons can become heavy. In 
the hmit, in which the imaginary parts of fi^, /ig, /ig, A4 and A7 vanish, the Pakvasa-Sugawara 
VEVs reduce to the 5*2 invariant VEVs as we can see also from 

c_ ^ (-4Im(/i2) + Im(A4)t;+ + 2V2lm{Xr)v+vs) (t;+/4Re(/i^)) + . . . , (98) 

where . . . stands for higher orders in the limit. 
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VI. SUPERSYMMETRIC EXTENSION 



As in the case of the minimal supersymmetric standard model (MSSM), we introduce 
two 5*3 doublet Higgs superfields, Hy,H['{i = 1,2), and two 5*3 singlet Higgs superfields, 
Hg,Hg jiol . h|. The same R-parity is assigned to these fields as in the MSSM. Then the 
most general renormalizable invariant superpotential is given by 

Wh = ^iiH^H^ + ^i.H^sH^- (99) 



The 5*3 invariant soft scalar mass terms are 10|, |ll| : 



~rnlum?)-rnlg{\H^\% (100) 



and the 5*3 invariant B terms are: 

Cb = B^iH'^H? + H^H?) + BsiH^H^) + h.c, (101) 



where hatted fields are scalar components. Given the superpotential ()99|) along with the 
5*3 invariant soft supersymmetry breaking (SSB) sector (|lUUp and (jlUlj) . we can now write 
down the scalar potential. For simplicity we assume that only the neutral scalar components 
of the Higgs supermultiplets acquire VEVs. The relevant part of the scalar potential is then 
given by 



'5 



+1(191 + gimri' + iH^i' + \Hi^\' - \Hn' - i^rp - \Hr\r 

-[ Bi(^?^^r + ^2''4°'') + BsiHf'Hl'') + h.c. ], (102) 

where gi^2 are the gauge coupling constants for the f/(l)y and SU{2)l gauge groups. As one 
can see easily, the scalar potential V ()102|) has a continues global symmetry SU{2) x U{1) in 
addition to the local SU (2)^, x f/ (l)y . As a result, there will be a number of pseudo Goldstone 
bosons that are phenomenologically unacceptable. This is a consequence of symmetry. 
Therefore, we would like to break 5*3 symmetry explicitly. As in the non-supersymmetric 
case, we would like to break it as soft as possible to preserve predictions from 5*3 symmetry. 
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while breaking the global SU{2) x f/(l) symmetry completely. There is a unique choice for 
that: Since the softest terms have the canonical dimension two, the soft 5*3 breaking should 
be in the SSB sector. As for the soft scalar masses, we have an important consequence (jlUUp 
from 5*3 symmetry that they are diagonal in generations. Since we would like to preserve 
this, the only choice is to introduce the soft 5*3 breaking terms in the B sector Moreover, 
looking at the 5*3 invariant scalar potential V ()1U2|) . we observe that it has again an abelian 
discrete symmetry 

S', : i/f'^ - H^'"", (103) 

which is the same as (|7j). We assume that the soft 5*3 breaking terms respect this discrete 
symmetry ()1U3|) . and add the following soft 5*3 breaking Lagrangian: 

Cs,B = B,{H^H^ + H^H^) + B,H^{H^ + H^) + B^H^iH^" + H^) + h.c. (104) 

In the following discussions, we assume that all the B parameters are real. The resulting 
scalar potential can be analyzed, and one finds that a local minimum respecting 5*2 symmetry, 
i.e. 

< HfJ > = < >= vu/2 y^O , < Hl^ >=< H^^ >= vd/2 0, 
<Hf> = vsu/V2 ^ , < >= vsd/V2 ^ 0, (105) 

can occur. To see this, we write down the minimization conditions in this case, which can 
be uniquely solved: 

{\[i\f^m\^) = {B.vsD + B.vsD + V2BeVsD)/vu + OiVEV^), (106) 
(l/^'r + K^) = (BsVsD + V2B,vd)/vsu + 0(VEV2), (107) 
{\fxl\^ + mln) = (B.vu + B^vu + V2B5Vsu)/vD + OiVEV'), (108) 
i\fil\^ + mln) = iB;Vsu + V2BeVu)/vsD + 0iVEV^), (109) 

Inserting these solutions into the scalar potential p02|) with ()104|) . we obtain the mass 
matrices for the Higgs fields. As in the non-supersymmetric case, we redefine the Higgs 
fields as 

H^'^ = ^(Hr^H^). (110) 
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Then the mass matrices can be written as 

^2 _ ( ((^1 + ^4)^D + V2BeVsD)/vu 

\ -Bi + 54 

for the ( H^, {H^Y ) basis, and 



-Bi + Bi 
{{Bi + Bi)vu + V2B^vsu)lvD 



+ 0(VEVl3lll) 



Mus 










Mu+ 


-V2B 


-S3 


-V2Bq 


Mds 




—Bi — B4 






0(VEV2 



-V2B5 \ 
-Bi — B4 


Md+ J 

for the ( H^, H^, {H^Y , {H^Y ) basis, where 

Mus = {B3VSD + V2B5Vd)/vsu, Mu+ = {{Bi + Bi)vD + V2BqVsd)Ivu, 
Mds = {Bsvsu + V2BeVu)/vsD, Md+ = + Bi)vu + V2B5Vsu)/vd- 



;ii2) 



(113) 
(114) 



From the mass matrices pil|) and pi2|) . we find that the hghtest physical Higgs boson, the 
MSSM Higgs boson, can be written as a hnear combination 



^MSSM = {vdHI'' + vsnHf + vuHf + vsuHf)/v, (115) 
where v = {vfj + + "^^d + '^'sdY^'^ — 246 GeV, and its mass is approximately given by 

^ ((3/5)^7? + gl){vl + vlu - 4 - 4d)V^ (116) 

for fi'^'s,B's » f^. It can be shown that the masses of the other physical Higgs bosons 
can be made arbitrary heavy. From ()116p we see that the tree-level upper bound for is 
exactly the same as in the MSSM. 

Because of the very nature of the SSB terms, the explicit breaking of 5*3 in the B sector 
()104p does not propagate to the other sector. Moreover, although the superpotential 
and the corresponding trilinear couplings do not respect S2 symmetry ()103|) . they can not 
generate S2 violating infinite B terms because they can generate only S3 invariant terms, 
which are however automatically S2 invariant. 



VII. CONCLUSIONS 



We recall that our investigations have been carried out under the two phenomenological 
conditions (fTlj) and (fT^. Below we would like to summarize our conclusions. 
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1: The S3 invariant Higgs potential Q does not satisfy the phenomenological 
requirement that 

"except one neutral physical Higgs boson all the physical Higgs bosons can become heavy 
^10 TeV without having a problem with triviality. " 

That is, for a phenomenological viable model we have to break S3 explicitly if we do not 
introduce further Higgs fields. 

2: Among the real nonequivalent soft 53 breaking masses (j^Hj) . ()29|) and ()31|) that can be 
characterized according to discrete symmetries, only the 5*2 invariant case (|29p with the 5*2 
invariant VEVs (jH)) can satisfy the phenomenological requirement of 1. 

3: Even for the most general quartic Higgs potential with the most general real S3 breaking 
masses fl21|) . the 6*2 invariant VEVs © can correspond to a local minimum and satisfy the 
phenomenological requirement of 1. 

4: The Pakvasa-Sugawara VEVs (j9T|l can be a local minimum in the case of the most general 
quartic Higgs potential with the most general complex ^3 breaking masses and can satisfy 
the phenomenological requirement of 1. 

5: In a minimal supersymmetric extension with the 6*2 invariant, real soft 5*3 breaking 
masses in the B sector, the phenomenological requirement of 1 can be satisfied with the 5*2 
invariant VEVs ()105|1 . where the other B parameters are also assumed to be real. These B 
terms violate supersymmetry as well as S3 softly. This possibility to introduce 5*2 violating 
soft terms in the B sector only is consistent with renormalizability. The lower bound of the 
lightest Higgs boson is the same as in the MSSM. 

It is a very difficult task to test the Higgs sector experimentally. However, as we see from 
(15 7|) and ()60|) . in the case of the 5*2 invariant soft breaking with the S2 invariant VEVs ©, 
there are basically only two masses rrih^ and mh_ for four neutral and two charged heavy 
Higgs bosons. This may be experimentally tested, because their couplings to the fermions 
are fixed 
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